Atomic Bose-Fermi mixtures in an optical lattice 
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A mixture of ultracold bosons and fermions placed in an optical lattice constitutes a novel kind of 
quantum gas, and leads to phenomena, which so far have been discussed neither in atomic physics, 
nor in condensed matter physics. We discuss the phase diagram at low temperatures, and in the 
limit of strong atom-atom interactions, and predict the existence of quantum phases that involve 
pairing of fermions with one or more bosons, or, respectively, bosonic holes. The resulting composite 
fermions may form, depending on the system parameters, a normal Fermi liquid, a density wave, a 
superfluid liquid, or an insulator with fermionic domains. We discuss the feasibility for observing 
such phases in current experiments. 



Since the first observation of Bosc-Einstcin condensa- 
tion (BEC) in atomic vapors y|, atomic physics has been 
constantly approaching research topics traditionally as- 
sociated with condensed matter physics, such as the anal- 
ysis of superfluidity in BEC 2| , or the on-going intensive 
search for the Bardeen-Cooper-SchriefTer (BCS) super- 
fluid transition in ultracold atomic Fermi gases |3,|J|- R- e ~ 
cently, striking experimental developments have driven a 
rapidly-growing interest on strongly correlated systems 
in atomic physics. In this sense, the control of the inter- 
atomic interactions via Feshbach resonances 5j has be- 
come particularly interesting, opening the way towards 
strongly- interacting gases |fj. Additionally, strong cor- 
relations are predicted to play a dominant role in low- 
dimensional systems, such as ID Bose gases (Tonks- 
Girardeau regime) ID Fermi systems (Luttinger liq- 
uid) 0, or rapidly-rotating 2D gases, where the physics 
resembles that of fractional quantum Hall effect [fj. 

The recent observation of the superfluid (SF) to Mott 
Insulator (MI) transition in ultracold atoms in optical 
lattices predicted in Ref. L llJ, constitutes up to 

now the most spectacular example of phenomena related 
to strongly-correlated atomic gases. In this experiment 
(performed with 87 Rb atoms), by changing the laser in- 
tensity and/or detuning, one can control the tunneling 
to neighboring sites as well as the strength of the on-site 
repulsive interactions, and therefore one is able to switch 
between the SF phase (dominated by the tunneling) and 
the MI phase with a fixed number of atoms per site ^(| • 

The possibility of sympathetic cooling of fermions with 
bosons has lead to several recent experiments on trapped 
ultracold Bose-Fermi mixtures p|. So far, temperatures 
T 0.05 Tp have been obtained, where Tp is the Fermi 
temperature at which the Fermi gas starts to exhibit 
quantum degeneracy (typically of the order of 10 fjK). 
Although the main goal of these experiments is to achieve 
the BCS transition in atomic Fermi gases, several groups 
recently show a growing interest towards the physics of 
ultracold Bose-Fermi mixtures themselves, including the 
analysis of the ground-state properties, stability, excita- 
tions, and the effective Fermi-Fermi interaction mediated 
by the bosons ^3] • Additionally, new experimental devel- 



opments have attracted the attention towards the behav- 
ior of these mixtures in ID geometries [lflj . and optical 
lattices 



In this letter, we investigate a Bose-Fermi lattice gas, 
i.e. a mixture of ultracold bosonic and fermionic atoms 
in an optical lattice. This system is somewhat similar to 
the Bose lattice gas of Ref. jjjj , yet much more complex 
and with a richer behavior at low temperatures. We dis- 
cuss the limit of strong atom-atom interactions (strong 
coupling regime) at low temperatures. Our main pre- 
diction concerns the existence of novel quantum phases 
that involve pairing of fermions with one or more bosons, 
or, respectively, bosonic holes, depending on the sign of 
the interaction between fermions and bosons jlfl ]. The 
resulting composite fermions may form a normal Fermi 
liquid, a density wave, a superfluid, or an insulator with 
fermionic domains, depending on the parameters charac- 
terizing the system. At the end of this paper, we discuss 
the experimental feasibility of the predicted phases. 



The lattice potential is practically the same for both 
species in a 7 Li- 6 Li mixture, and accidentally very similar 
for the 87 Rb- 40 K case (for detunings corresponding to the 
wavelength 1064 nm of a Nd:Yag laser [13). Due to the 
periodicity of this potential, energy bands are formed. If 
the temperature is low enough and/or the lattice wells 
are sufficiently deep, the atoms occupy only the lowest 
band. Of course, for fermions this is only possible if their 
number is smaller than the number of lattice sites (fill- 
ing factor pp < 1). To describe the system under these 
conditions, we choose a particularly suitable set of single 
particle states in the lowest band, the so-called Wannier 
states, which are localized at each lattice site. The sys- 
tem is then described by the tight-binding Bose-Fermi- 
Hubbard (BFH) model (for a derivation from a micro- 
scopic model, see Ref. [l4|), which is a generalization of 
the fermionic Hubbard model, extensively studied in con- 
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densed matter theory (c.f. 18]): 

ffBFH = -J2( J Bbtb j + J F f}f j +h. C .) 
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where &j, bj, f}, fj are the bosonic and fermionic 
creation-annihilation operators, respectively, rii = b\bi, 
rrii — fj fi, and p, is the bosonic chemical potential. The 
fermionic chemical potential is absent in Hbfh, since the 
fermion number is fixed. The BFH model describes: i) 
nearest neighbor boson (fermion) hopping, with an asso- 
ciated negative energy, —Jb (—Jf)\ m the following we 
assume Jf = Jb = J, while the more general case of 
different tunneling rates will be analyzed elsewhere; ii) 
on-site repulsive boson-boson interactions with an asso- 
ciated energy V; iii) on-site boson-fermion interactions 
with an associated energy U, which is positive (negative) 
for repulsive (attractive) interactions. 

In this letter we are interested in the strong-coupling 
limit, J <C U, V , which can be easily reached experimen- 
tally by increasing the lattice intensity. We first analyze 
the case of vanishing hopping (J = 0). For the simplest 
case of U = 0, at zero temperature, the fermions can 
occupy any available many-body state, since the energy 
of the system does not depend on their configuration. 
Bosons on the contrary are necessarily in the MI state 
with exactly n = \p] + 1 bosons per site, where [p] de- 
notes the integer part of p = p/V. For small \U\ ^ 0, the 
system is only perturbatively affected. However, if U > 
is sufficiently large, U > ji— (n — 1)V, the fermions push 
the bosons out of the sites that they occupy. Hence, lo- 
calized composite fermions are formed, consisting of one 
fermion and the corresponding number of missing bosons 
(bosonic holes). Similarly, if U < fj, — nV, the fermions 
will attract bosons to their sites, and again localized com- 
posite fermions are formed, but now consisting of one 
fermion and the corresponding number of bosons. 

Fig. ^a) shows the phase diagram of the system in 
the a — p plane, where a — U/V. Quite generally, for 
p — [p] + s > a > p — [p] + s — 1 , we obtain that s holes (or, 
for s < 0, — s bosons) form with a single fermion a com- 
posite fermion, annihilated by ft — \/{n — s)\/h\(b\) s fi 
( yjh\/{fi — s)\(bi)~ s fi ). Since the maximal number of 
holes is limited by fi, s must not be greater than n; it 
can, on the other hand, attain arbitrary negative inte- 
ger values, i.e., we may have fermion composites of one 
fermion and many bosons in the case of very strong at- 
tractive interactions, a < 0, and \a\ ^ 1. In Fig. QJa) 
the different regions in the phase diagram are denoted 
with Roman numbers I, II, III, IV etc, which denote the 
number of particles that form the corresponding compos- 
ite fermion. Additionally, a bar over a Roman number 
indicates composite fermions formed by one bare fermion 



and bosonic holes, rather than bosons. 

Although our composite fermions neither move, nor 
interact with each other (J = 0), the phase diagram is 
quite complex. As a result, switching on a small, but 
finite hopping, leads to an amazingly rich physics. The 
latter can be investigated on the basis of an effective the- 
ory for composite fermions, which can be derived using 
degenerate perturbation theory (to second order in J) 
along the lines of the derivation of the t — J model (see 
e.g. Ref. Remarkably, the resulting effective model 

is universal for all the distinct regions in the phase di- 
agram in Fig. ^a) , and the corresponding Hamiltonian 



H eff = -Jeff ^2(fjfj 
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is determined by two effective parameters describing: i) 
nearest neighbor hopping of composite fermions with the 
corresponding negative energy —J e ff] ii) nearest neigh- 
bor composite fermion-fermion interactions with the as- 
sociated energy K e ff, which may be repulsive (> 0) or 
attractive (< 0). In Eq. J2J) we employ the number op- 
erator rhi = fj.fi- This effective model is equivalent to 
that of spinless interacting fermions (c.f. [ly, 20]), and, 
despite its simplicity, has a rich phase diagram. The co- 
efficient K e f f has the universal form 



K, 
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n(n + 1 — s) (n — s)(n + 1) 
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H h(h + 1) — (n — s)(n + 1 — s) 
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whereas the dependence of J e // on J, V, and U, has dif- 
ferent forms in different regions of Fig. ^a). E.g. for 
< p < 1, J eff = J (in I), 2J 2 /aV (in 77), U 2 /\a\V 
(in II), etc. The physics of the effective model is deter- 
mined by the ratio A = K e ///2 J e //, and by the sign of 
K e ff. In Fig.^a) the subindex A (R) denotes attractive 
(repulsive) interactions. 

The problem of finding the ground state of the BFH 
model is then reduced to the analysis of the ground state 
of the spinless Fermi model J2| • In the case of a repulsive 
effective interaction, K e ff > 0, and filling fraction close 
to zero, pp <^ 1, or one, 1 — p F <C 1, the ground state of 
Heff corresponds to a Fermi liquid (a metal), and is well 
described in the Bloch representation. In the considered 
cases, the relevant momenta are small compared to the 
inverse lattice constant (the size of the Brillouin zone). 
One can thus take the continuous limit, in which the first 
term in H e f / corresponds to a quadratic dispersion with 
a positive (negative) effective mass for particles (holes), 
while the second term describes p-wave interactions. The 
lattice is irrelevant in this limit, and the system is equiv- 
alent to a Fermi gas of spinless fermions (for pp <C 1), or 
holes (for 1 — pF *C 1). Remarkably, this gas is weakly in- 
teracting for every value of K e ff, even when K e ff — > oo. 
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The latter case corresponds to the exclusion of the sites 
that surround an occupied site from the space available 
for other fermions. As a result, the scattering length re- 
mains finite, being of the order of the lattice spacing. 
Therefore, 1 — pp {pf) acts as the gas parameter for the 
gas of holes (particles). This picture can be rigorously 
justified using renormalization group approach [20|. 

The weakly-interacting picture becomes inadequate 
near half-filling, pp — > 1/2, and for large A, where the ef- 
fects of the interactions between fermions become impor- 
tant, and one expects the appearance of localized phases. 
A physical insight on the properties of this regime can be 
obtained by using Gutzwiller ansatz (GA) [21|, in which 
the ground state is a product of on-site states with 
or 1 composites, Y\ i {cos9i/2\l)i + suv9i/2e' f ' i \Q)i), and 
which is in fact well-suited for describing the states with 
reduced mobility and, therefore, with small correlations 
between different sites. Such an approach allows to de- 
termine the boundaries of various quantum phases rel- 
atively well in 3D, 2D, and even ID, but does not pro- 
vide the correct description of correlations and excita- 
tions; these failures become particularly important in ID, 
where, strictly speaking, the GA approach is inappropri- 
ate. For K e ff > the GA approach maps H e ff onto 
the classical antiferromagnetic spin model with spins of 
length 1, Si = (sin 0* cos fa, sin di sin fa, cos 8i) 18]. The 
correspondin g gr ound state is a spin-flop (canted) anti- 
ferromagnet |l8l Hij with a constant density, provided 
A < A cr jt = (1 + m 2 z )/(\ — m 2 z ), where the "magneti- 
zation per spin" is m z = 2pp — 1. When A > A cr a, 
the GA ground state of the classical spin model exhibits 
modulations of m z with a periodicity of two lattice con- 
stants. We expect that the employed GA formalism pre- 
dicts the phase boundary A cr ^ accurately for pp close 
to 1/2. Coming back to the composite fermion picture, 
we predict thus that the ground state for A < A crit is 
a Fermi liquid, while for A > A cr i t it is a density wave. 
For the special case of half filling, pp = 1/2, the ground 
state is the so-called checkerboard state, with every sec- 
ond site occupied by one composite fermion. One should 
stress that the GA value of A cr u is incorrect for filling 
factors pp close to or 1. In particular, the GA approach 
predicts that A cr .jt tends gradually to infinity and the 
density wave phase gradually shrinks as pp — * or 1, 
i.e. 1 — m? z — > 0. As discussed above, an analysis beyond 
the GA approach shows the disappearance of the density 
wave phase already for a finite non-zero value of 1 — m 2 z . 

The situation is different when the effective interac- 
tion is attractive, K e ff < 0, which in the spin descrip- 
tion corresponds to ferromagnetic spin couplings. In 
the GA approach the ground state for > A > — 1 
is ferromagnetic and homogeneous. In this description, 
fixing the fermion number means fixing the z compo- 
nent of the magnetization M z = N(2pp — 1). When 
A | <C 1, and pp is close to zero (one), i.e. low (high) 
lattice filling, a very good approach to the ground state 
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Figure 1: (a) Phase space as a function of p and a — U/V. 
See text for details on the notation; (b) Full phase diagram 
for the region < p < 1, for p f = 0.4 and J/V = 0.02. Dif- 
ferent phases are present, including fermionic domains (FD), 
superfluid (SF), Fermi liquid (FL) and density- wave phase 
(DW). 



is given by a BCS ansatz 22], in which the compos- 
ite fermions (holes) of opposite momentum build p-wave 

Cooper pairs, Ilfc( w fcl %._£ + ""d 1 ' !)£._£)> where 
and are the coefficients of the Bogoliubov transfor- 
mation. The ground state becomes more complex for ar- 
bitrary pp, and for A approaching —1 from above. The 
system becomes strongly correlated, and the composite 
fermions in the SF phase may build not only pairs, but 
also triples, quadruples etc. The situation becomes sim- 
pler when A < — 1. In the spin picture the spins form 
then ferromagnetic domains with spins ordered along the 
z-axis. In the fermionic language this corresponds to the 
formation of domains of composite fermions ("domain" 
insulator). This mean-field result is in fact exact. 

Fig. |IJb) shows the cases /, II and II for < p < 1, 
with the predicted quantum phases. The observation of 
the predicted phases, constitutes a challenging, but def- 
initely accessible, goal for experiments. Systems of dif- 
ferent dimensionalities are nowadays achievable by con- 
trolling the potential strength in different directions [2^ . 
The conditions for the exclusive occupancy of the low- 
est band, and for J <C V, U, are fulfilled for sufficiently 
strong lattice potentials, as those typically employed in 
current experiments |lfj (10-20 recoil energies). Addi- 
tionally, our T = analysis is valid for T much lower 
than the smallest energy scale in our problem, namely 
the tunneling rate. This regime is definitely accessible for 
sufficiently large interactions. In typical experiments, the 
presence of an inhomogeneous trapping potential leads to 
the appearance of regions of different phases lllj.1241 , and 
it is crucial for the observation of MI phases 10]. The 
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inhomogeneity controls thus the bosonic chemical poten- 
tial, which can also be tailored by changing the num- 
ber of bosons in the lattice, regulating the strength of 
the lattice potential, and/or modifying the interatomic 
interactions by means of Feshbach resonances We 
would like also to note that for J <C V, phases /, II and 
II are easier to study, since the fermions, or composite 
fcrmions, attain effective hopping energies that are not 
too small, and can compete with the effective interactions 
K e f f . The predicted phases can be detected by using two 
already widely employed techniques. First, the removal 
of the confining potentials, and the subsequent presence 
or absence of interferences in the time of flight image, 
would distinguish between phase-coherent and incoher- 
ent phases. Second, by ramping-up abruptly the lattice 
potential, it is possible to freeze the spatial density cor- 
relations, which could be later on probed by means of 
Bragg scattering. The latter should allow to distinguish 
between homogeneous and modulated phases. An inde- 
pendent Bragg analysis for fcrmions and bosons should 
reveal the formation of composite fermions. 

In this Letter we have shown that the phase diagram 
for Bose-Fermi lattice gases in the strong coupling limit 
is enormously rich, and contains several novel types of 
quantum phases involving composite fcrmions, which for 
attractive (repulsive) Bose-Fermi interactions are formed 
by a fermion and one or several bosons (bosonic holes). 
The predicted ground-state solutions include delocalized 
phases (metallic, superfluid), and localized ones (den- 
sity wave and domain insulator). The remarkable devel- 
opment of the experimental techniques for cold atomic 
gases allows not only for the observability of the pre- 
dicted phases, but also for an unprecedented degree of 
control not available in other condensed matter systems. 

In the ID case, due to the leading role of fluctuations, 
mean-field theories become inaccurate. In ID we can, 
however, use the Wigner-Jordan transformation to con- 
vert the effective model into the quantum spin 1/2 chain, 
the so-called XXZ model , with a fixed magnetization 
fiz — Pf~ 1/2, whose ground state is known exactly from 
Bethe Ansatz |2.4 \2(\ . The coefficient characterizing the 
spin coupling on the x — y plane will then be J e ///2, 
whereas that in the z direction will be K e ff/4. 

Finally, we would like to stress that interesting physics 
is also expected when J is comparable to U and V. For 
finite J the phase diagrams should be extended to three- 
dimensions by adding the J/V axis, and will develop a 
lobe structure in the J/V — ji plane, similar to that oc- 
curring in MI phases in the Bose-Hubbard model [l9| . 
This analysis, as well as the studies of the excitations in 
this system, will be the subject of a separate paper. 
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